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CORRELATES OF STUDENT PREFERENCE RATINGS-"- 

Barak Rosenshlne 
University of Illinois at Urbana 
Alan Cohen 
and 
Norma Furst 

~— ■ Te i apla Uftivcgotty ■ " 

The purpose of this study was to analyze the data from a student 
evaluation survey of courses and inscructors in order to determine whether 
certain demographic variables were related to student ratings of courses 
or instructors, and which rating variables were related to certain "pre- 
ference criteria." 

The AO-item "Course Evaluation Survey" was administered to students 
in 1200 daytime, on-camptis, undergraduate classes in all the colleges and 
schools of Temple University in Spring, 1970. The questionnaire items 
were drawn from existing instruments. The first seven items on the survey 
were demographic variables (e.g., marital status^rade point average, expected 
grade, sex, number of previous courses in this field), which were included 
in order to determine whether ratings of the course or the instructor were 
differentially ^iS&s^ssSdiy these variables. The content of the remaining 
31 items, each on a four-point scale, ranged from fairly specific descriptions 
of the course or the instructor to global evaluations. 

Procedure 

Five global items were selected as "preference criteria" for this scudy 
because they were the items of greates^^nterest to students and faculty in 
the Course Evaluation Survey (1970), and because the items were similar to 
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.^I'jiwrence criteria used in other studies (Costin, Greenough, Menges, 1971). 
Tr.cse icems v;ere: compare this Instructor to your other college instructors, 
would you recommend this instructor to a friend, compare this course to your 
onher college courses, would you recommend this course to a friend,^was this 
course worthwhile to attend. 

The intercorrelations among the five preference criteria ranged from 
• A8 to -73 (Table 1), indicating the criteria were measuring the same thing 



Insert Table 1 about here 



to sorr.e extent, but the intercorrelations were not high enough to warrant 
selecting only one preference criterion. For brevity, the two most redundant 
criteria were deleted from the rest of this article ("Would you recommend 
this instructor to a friend," "Would you recommend this course to a friend"). 
The results with three preference criteria were the same as they would have 
been with five preference criteria. 

Class mean scores on each of the demographic variables and each of the 
26 remaining descriptive variables were then correlated with class mean scores 
on each of the preference criteria. 

Results 

Seven demographic variables were Included in the survey: year in school, 
grade point average, expected grade in the course, sex, age, number of pre- 
vious courses in this field, and marital status. The correlations between 
each of the demographic variables and each of the preference criteria are 
presented in Table 2. None of these variables had correlations above .2 with 

Insert Table 2 about here 
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: c subt>;.'quant racings, and most of the correlations were .1 or less. 

of significance are not very meaningful because for a sample larger 
i.uOO, a correlation of .06 is significant at the five percent level. 
Vc-c, two results in this table are of interest. First, those who expected 
a hU'her srade in the course tended to give more favorable ratings on the 
nrc-ierence criteria (rs = .09 to .27). Second, there was a tendency for 
: ore e .pcrienced students (those tvho were older, had more courses in the 
field, '..'ere upper-classmen, were married) to give higher ratings, although 
of those correlations was as high as .10^ — . — 



-Tin ;.y-_or!e. 



The correlations between each of the descriptive items and the pre- 
ference criteria are presented in Table 3. The cable is divided into three 
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parts according to the strength of the relationships between the descriptive 
items and the preference criteria. The strongest correlates, those items 
which had a correlation of .5 or higher with two or more of the preference 
criteria, are in the first section. The moderate predictors are in the second 
part . The lowest predictors . those items which yielded an average correlation 
of .2 with the five criteria, are in the third part. 



Discussion 



The lack of any meaningful correlations between the demographic variables 
used in this study and the five preference criteria cross-validates results 
obtained in other studies of this type. The results of this study add strength 
to the generalization that these variable have relatively little influence 
on class mean student ratings. (For a review of additional studies employing 
demographic variables see Costin, Greenough, and Menges, 1971.) 



Three of the highest correlations in this study are comparable to 
cho.se obcained in other studies. In their review, Costln, Greenough, and 
Mcn.vs (1971) cited the variables which had the highest correlations with 
SLUcent preference criteria in 10 additional studies. Four variables appeared 
in CiZ least six of the ten studies: clarity or organization of class, teacher 
cnL:.u.si.:sm or interest in the material, whether the teacher stimulated student 
curiosity or interest, and whether the teacher was well prepared or knew 
the subject. The first three of these variables are also among the variables 
which had high correlations with student preference criteria in this study, 
ih.e fourth, teacher knowledge of course material, appeared among the moderate 
correlates in this study. 

The overall results in this study are comparable to the results obtained 
in sr.udies in which similar descriptive variables were correlated with student 

reviews of studies on descriptive variables and student 
achicvei?.enc (Rosenshine, 1971; Rosettshine & Furst, 1971), variables such as 
teacher clarity and teacher enthusiasm were consistently, significantly related 
to student achievement, and variables such as student participation or teacher 
lecturing were not significantly related to student achievement. However, it 
v;ould be unwise to extrapolate from this finding and use student preference 
ratings as '^proxy variables" for student achievement, at this time . Rather, 
investigators who use student questionnaires to determine correlates of student 
achievement are advised to include a number of global student preference meas- 
ures such as the ones used in this study. 

The most interesting findings in this study are the variables which had 
the lowest correlations with student preference criteria: teacher lecturing, 
willingness to meet students outside class, criticism of students in a destruc- 
tive way, importance of class participation for the final grade, whether 
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interpretation of ideas was Important for the final grade and whether 
criticism of papers was helpful. Although these last variables are frequently 
cited as being "obviously important" for college teaching, their importance 
is not borne out by these data. Similarly, equally obvious variables such 
as instructor encouraged discussion, instructor encouraged creativity, and 
instructor handled course in innovative ways had only moderate correlations 
(.2 to .3) with the preference criteria. ^ 

In contrast to the low correlations on the variables above, the students 

in the 12GG-cl"55nc5 in this sample believed that "good teaching" Is most 

strongly associated with clarity of presentation, continuity of course organ- 
ization, instructor enthusiasm, and a feeling that they learned something. 
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Footnotes 

^i..;is article was written while all three authors were at Temple University, 
"^your additional variables also had lew correlations with the preference 
criteria. These were items on whether (a) independent projects and papers, 
(b) clasa participation, (c) creative thinking, or (d) interpretation and appli- 
cation vero ii^iportant for the final grade. These items may be Inappropriate 
in a .iuucy of this type because the questionnaire is usually administered before 
che final ;;rade is received. In addition, anecdotal information indicated that 
..Lv.v.<-.-ts paid littlT' caiLieuLlon to thocQ four iteas wlieu us ing the published 
pr in touts to select Instructors for future courses. 
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Table 2 



Co 



rreiacions Between Demographic Variables and Preference Criteria 



Compare 
instructor 



Compare Worthwhile 
course to attend 



Year in school*^ 
Gr::do point average^ 
r,:: 'C-cteci prade^ 



...... '^ar of previous 

co../3e3 in this field^ 



r.arital status*^ 



.00 
.00 
.09 
.06 

.07 
.10 
.OA 



.06 
.02 
.27 
.OA 

.10 
.11 
.02 



.01 
.02 
.12 
.07 

.06 
-.OA 
.02 



^Students who were higher on these variables (e.g., older, higher CPA) 
tcr.ced CO give more positive preference ratings. 

i>Scored as 1 for male and 2 for female, meaning that men gave higher 
ratings on "compare instructor" and "worthwhile to attendj* and women gave 
higher ratings on "compare course." 

csinglc people tended to give higher ratings on the preference variables . 



TabL 

: rci^'crc^^c Criteria Correlated with Other C' 

•-'^'J- cv)..^;.. :.r.d Ins tructor correlations 
1. :r..->iructor*s presen^tion was clear 

r.r.c understandable. 
9. Ir..sjructor \:as enthusiastic* 
15. Overall development of course had 

cor.iinuity . 
IS. Subject matter was interesting and 

ocirnulating. 
27. Kcice how much you learned in this 
• course. 

29. Instructor's main emphasis was on 
having students enjoy the course. 

?Ioderat 3 course and instructor correlations 
4, Instructor encouraged discussion. 
8. Instructor encouraged creativity. 

10. Instructor was tolerant of other 
points of view. 

14. Grading it. course was fair. 

11. Instructor knew course material* 

12. Instructor stimulated independent 
re ading. 



3 

rse and Instructor Behavioral Criteria 



16 17 2 

Compare Compare Worthwhile 

instructor course to attend 

.62 .^3 .62 

.57 .43 .50 

.52 .A7 .52 

•54 .69 .57 

.57 .66 .60 

.50 .50 .43 

.32 .34 .26 

.45 .39 .37 

.42 .34 -33 

.46 .38 .37 

.40 .29 .35 

.43 .40 .37 
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Table 3 (continued) 



16 
Compare 
instructor 



'oz.-;:.:cc- ccuisc a nd instructo r c orrelation s fcMHI*} 
13. I.-.scructor handled course in innova- 
tive ways. 

II'. Instructor's main emphasis was on 
^-;-..'.->nr l earning. „ 



.A3 



.40 



17 
Coinpare 
course 



.35 



.38 



Worthwhile 
to attend 



.31 



.Al 



Low c ourse fir.a instru ctor correlations 
3. ^icur.se canducted by lecturing, 

6. Vr.structor willing to meet with 
students outside class. 

7. Instructor criticized student 
responses in destructive way. 

20. Instructor used assigned papers as 
cTi aid in learning. 

21. Criticism of papers was helpful to 
students. 



-.08 



.26 



-.16 



.21 



.26 



-.09 



.30 



-.23 



.15 



.17 



.00 



.25 



-.16 



.13 



.17 
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